Information processing apparatus and method, display control apparatus and method, reproducing apparatus and method, and information processing system

ABSTRACT

The present technology relates to an information processing apparatus and method, a display control apparatus and method, a reproducing apparatus and method, a program, and an information processing system that transmit a response of viewers acquired in a more natural way to a place where content is captured, enabling presentation in an easier-to-see way. The information processing apparatus of one aspect of the present technology receives motion information indicating motions of users watching video content and information indicating attributes of the users, and generates an excitement image by arranging information visually indicating a degree of excitement of each user determined on the basis of the motion information transmitted from a plurality of reproducing apparatuses at a position according to an attribute of each user. The present technology is applicable to a server that processes information transmitted from the reproducing apparatuses of content distributed in real time via a network.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a U.S. National Phase of International PatentApplication No. PCT/JP2015/069382 filed on Jul. 6, 2015, which claimspriority benefit of Japanese Patent Application No. JP 2014-147597 filedin the Japan Patent Office on Jul. 18, 2014. Each of theabove-referenced applications is hereby incorporated herein by referencein its entirety.

TECHNICAL FIELD

The present technology relates to an information processing apparatusand method, a display control apparatus and method, a reproducingapparatus and method, a program, and an information processing system,and in particular to an information processing apparatus and method, adisplay control apparatus and method, a reproducing apparatus andmethod, a program, and an information processing system that transmit aresponse of viewers acquired in a more natural way to a place wherecapturing of content is performed, enabling presentation in aneasier-to-see way.

BACKGROUND ART

In recent years, various services to distribute moving pictures ofconcerts or sport games in real time have been provided. Viewers canwatch content of the moving pictures distributed from a server by usingtheir terminals such as PCs and smartphones.

There is also a technology to transmit a reaction of viewers who arewatching content via the Internet to a venue and to present the reactionto spectators or the like who are in the venue.

CITATION LIST Patent Document

-   Patent Document 1: Japanese Patent Application Laid-Open No.    2005-339479-   Patent Document 2: Japanese Patent Application Laid-Open No.    2011-182109

SUMMARY OF THE INVENTION Problems to be Solved by the Invention

In the above-described technology, the viewers of the content need totake, so to speak, active operations such as pushing buttons displayedon terminals used for watching the content in order to transmit theirreaction to the venue. Therefore, sending the reaction causes anobstruction to being absorbed in watching the content.

The present technology has been made in view of such a situation andaims to transmit a response of the viewers acquired in a more naturalway to a place where capturing of the content is performed, and toenable presentation in an easier-to-see way.

Solutions to Problems

An information processing apparatus according to a first aspect of thepresent technology includes: a receiving unit configured to receivemotion information indicating a motion of a user who is watching videocontent and information indicating an attribute of the user transmittedfrom a reproducing apparatus that receives and reproduces the real timevideo content with a display range switched following the motion of theuser who is a viewer within a range of a captured entire video; ageneration unit configured to generate an excitement image by arranginginformation that visually indicates a degree of excitement of each ofthe users determined on the basis of the motion information transmittedfrom the plurality of reproducing apparatuses at a position according tothe attribute of each of the users; and a transmitting unit configuredto transmit data of the excitement image to a display control apparatusthat causes a display apparatus installed in space where capturing ofthe video of the video content is performed to display the excitementimage.

A display control apparatus according to a second aspect of the presenttechnology includes: a receiving unit configured to receive motioninformation indicating a motion of a user who is watching video contentand information indicating an attribute of the user transmitted from areproducing apparatus that receives and reproduces the real time videocontent with a display range switched following the motion of the userwho is a viewer within a range of a captured entire video, and toreceive data of an excitement image transmitted from an informationprocessing apparatus that generates the excitement image by arranginginformation that visually indicates a degree of excitement of each ofthe users determined on the basis of the motion information transmittedfrom the plurality of reproducing apparatuses at a position according tothe attribute of each of the users; and a display control unitconfigured to cause a display apparatus installed in space wherecapturing of the video of the video content is performed to display theexcitement image on the basis of the data of the excitement image.

A reproducing apparatus according to a third aspect of the presenttechnology includes: a receiving unit configured to receive real timevideo content with a display range switched following a motion of a userwho is a viewer within a range of a captured entire video; a reproducingunit configured to reproduce the video content; a detection unitconfigured to detect the motion of the user; a display unit configuredto display the video of the display range according to the motion of theuser; and a transmitting unit configured to transmit motion informationindicating the motion of the user who is watching the video content toan information processing apparatus that aggregates the motioninformation together with information indicating an attribute of theuser.

Effects of the Invention

The present technology enables transmission of the response of theviewers acquired in a more natural way to the place where capturing ofthe content is performed, and enables presentation in an easier-to-seeway.

It is to be noted that effects described here may not necessarily belimited, and may be any effect described in the present disclosure.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a diagram illustrating a configuration example of aninformation processing system according to one embodiment of the presenttechnology.

FIG. 2 is a plan view illustrating an example of an event venue.

FIG. 3 is a diagram illustrating an example of an angle of view of avideo.

FIG. 4 is a diagram illustrating another example of the angle of view ofthe video.

FIGS. 5A, 5B and 5C are diagram illustrating an example of the video.

FIG. 6 is a diagram illustrating an example of a visual field.

FIG. 7 is a diagram illustrating an example of a heat map image.

FIG. 8 is a block diagram illustrating a configuration example of anHMD.

FIG. 9 is a block diagram illustrating a functional configurationexample of a control unit.

FIG. 10 is a diagram illustrating an example of information included inuser attribute information.

FIG. 11 is a block diagram illustrating a configuration example of anaggregation server.

FIG. 12 is a block diagram illustrating a functional configurationexample of the aggregation server.

FIG. 13 is a block diagram illustrating a functional configurationexample of a distribution server.

FIG. 14 is a block diagram illustrating a configuration example of adisplay control apparatus.

FIG. 15 is a block diagram illustrating a functional configurationexample of the display control apparatus.

FIG. 16 is a flowchart illustrating content distribution processing ofthe distribution server.

FIG. 17 is a flowchart illustrating reproduction processing of a clientterminal.

FIG. 18 is a flowchart illustrating excitement aggregation processing ofthe aggregation server.

FIG. 19 is a flowchart illustrating heat map image display processing ofthe display control apparatus.

FIG. 20 is a flowchart illustrating the heat map image displayprocessing of the client terminal.

FIG. 21 is a diagram illustrating a display example of a display.

FIG. 22 is a diagram illustrating another example of the heat map image.

FIG. 23 is a diagram illustrating an example of arrangement ofinformation indicating a degree of excitement.

FIG. 24 is a diagram illustrating an example of switching of display ofthe heat map image.

FIGS. 25A, 25B and 25C are diagram illustrating an example of a form ofthe HMD.

MODE FOR CARRYING OUT THE INVENTION

Hereinafter, a form for implementing the present technology will bedescribed. The description is made in the following order.

1. Configuration of information processing system

2. Configuration of each device

3. Operation of each device

4. Example of heat map image

5. Variations

<Configuration of Information Processing System>

FIG. 1 is a diagram illustrating a configuration example of aninformation processing system according to one embodiment of the presenttechnology.

The information processing system of FIG. 1 is a system that distributesmoving pictures obtained by capturing concerts, sport games, and thelike in real time.

The information processing system of FIG. 1 includes apparatuses on anevent venue side where a concert or the like is held, a distributionserver 11, an aggregation server 12, and head mounted displays (HMDs) 21to 24 used by viewers of live content.

While FIG. 1 illustrates four HMDs as client terminals, more clientterminals may be provided. It is also possible that the distributionserver 11 and the aggregation server 12 are installed in the eventvenue. In addition, it is also possible to implement functions of thedistribution server 11 and the aggregation server 12 with one server.Respective apparatuses are connected via a network such as the Internet.

A capturing control apparatus 1, a display control apparatus 2, and alarge display 3 are provided in the event venue. In the example of FIG.1, a concert is held in the event venue, and three persons as performersand spectators of the concert are in the event venue. The large display3 is installed at a position both the performers and the spectators cansee.

The capturing control apparatus 1 controls cameras installed in theevent venue and controls capturing of the concert. The capturing controlapparatus 1 transmits a captured moving picture to the distributionserver 11 over the network.

The distribution server 11 generates live content for distribution onthe basis of the moving picture transmitted from the capturing controlapparatus 1, and then transmits the live content to the HMDs 21 to 24.The live content transmitted from the distribution server 11 is, forexample, content including videos captured at a plurality of positionswith an angle of view in at least one of a horizontal direction and avertical direction being 360 degrees.

For example, a user of the HMD 21 who receives the live contenttransmitted from the distribution server 11 can select a visual pointand watch the video from the selected visual point while changing avisual field. The live content transmitted from the distribution server11 is so-called free visual point content with a changeable visualpoint.

Each of the HMDs 21 to 24 is equipped with a sensor for head tracking,such as an acceleration sensor and an angular velocity sensor. Each ofthe HMDs 21 to 24 detects a posture of a head of the user wearing eachof the HMDs 21 to 24, and then switches a display range of the videoaccording to a direction of a line of sight guessed from the posture ofthe head. Of the entire angle of view of 360 degrees, the user will seea certain range of the video that is in a direction in which the userfaces.

Here, “the visual point” is a standpoint of the user who sees an object.Also, “the visual field” is a range the user sees, and corresponds tothe range of video displayed on a display (display range). “The line ofsight” is a direction of the user's visual field, and corresponds to adirection of the display range of the video on the basis of apredetermined direction in capturing space.

FIG. 2 is a plan view illustrating an example of the event venue.

A stage #1 is provided in the event venue, and a spectator floor #2 isprovided ahead of the stage #1 (in a lower part of FIG. 2). Threesingers of persons H1, H2, and H3 are on the stage #1. In addition, alot of spectators are in the spectator floor #2, behind which isinstalled the large display 3. A subject is a scene of the entire eventvenue.

Positions P1 to P3 are capturing positions of videos. At each of thepositions P1 to P3 is installed a camera capable of capturing a videowith an angle of view in at least one of the horizontal direction andvertical direction being 360 degrees. By installation of a plurality ofcameras with different capturing ranges at respective capturingpositions and composition of the videos captured by the cameras, a videowith the capturing positions of the positions P1 to P3 and the angle ofview of 360 degrees may be generated.

Hollow arrows A1 to A3 indicate reference directions at the positions ofthe positions P1 to P3, respectively. In the example of FIG. 2, thedirection of the stage #1 is the reference direction.

FIG. 3 is a diagram illustrating an example of the angle of view of thevideos to be captured at the positions P1 to P3.

For example, when a wide-angle lens is pointed at right above at each ofthe positions P1 to P3 and capturing is performed, as illustrated inFIG. 3, the video of a half celestial sphere range is captured in whichan optical axis L1 illustrated in alternate long and short dash linecrosses a zenith. The angle of view of FIG. 3 is an angle of view of 360degrees in the horizontal direction and 180 degrees in the verticaldirection.

As illustrated in FIG. 4, the video of an entire celestial sphere rangewith the angle of view in both horizontal direction and verticaldirection of 360 degrees may be captured at each of the positions P1 toP3. Here, when represented in latitude/longitude using equidistantcylindrical projection, the video of the entire celestial sphere rangemay be represented as 360 degrees in the horizontal direction and 180degrees in the vertical direction; here, in order to distinguish fromthe half celestial sphere range of FIG. 3, the angle of view in bothhorizontal direction and vertical direction are 360 degrees.

For convenience of description, the following describes a case where thevideo captured at each of the positions P1 to P3 is the video of thehalf celestial sphere range illustrated in FIG. 3.

FIGS. 5A, 5B and 5C are diagrams illustrating examples of the videoscaptured at the positions P1 to P3, respectively.

The half celestial spheres of FIGS. 5A, 5B and 5C indicate the entirevideos of one frame of the moving pictures captured at the positions P1to P3, respectively.

As illustrated in FIG. 5A, at the position P1, the moving picture iscaptured in which the person H1 is reflected large in the direction ofthe stage #1 indicated by the hollow arrow A1, and the person H2 isreflected smaller than the person H1 on a right side of the person H1.The person H3 will be reflected still smaller on a right side of theperson H2. The spectators who face the direction of the stage #1 arereflected in the opposite direction of the stage #1.

As illustrated in FIG. 5B, at the position P2, the moving picture iscaptured in which the person H3 is reflected large in the direction ofthe stage #1 indicated by the hollow arrow A2, and the person H2 isreflected smaller than the person H3 on a left side of the person H3.The person H1 will be reflected still smaller on a left side of theperson H2. The spectators who face the direction of the stage #1 arereflected in the opposite direction of the stage #1.

As illustrated in FIG. 5C, at the position P3, the moving picture iscaptured in which the entire stage #1 is reflected on a far side in thedirection indicated by the hollow arrow A3, and on a near side thereof,back sight of the spectators who face the direction of the stage #1 isreflected. Although illustration is omitted, the large display 3 isreflected on an opposite side of the spectators.

FIG. 6 is a diagram illustrating an example of the visual field at theposition P1.

A range of a frame F1 illustrated in dashed line on a surface of asphere of FIG. 6 indicates, for example, the display range of the HMD21, that is, the visual field of the user of the HMD 21. In the HMD 21,an image within the range indicated by the frame F1 is cut out from eachframe and is displayed as a moving picture.

In response to the user moving the head, the frame F1 moves as indicatedby arrows, and the range displayed on the display of the HMD 21 is alsoswitched. A shape and size of the frame indicating the range of thevisual field will change according to an aspect ratio and viewing angleof the display included in each client terminal. The visual field of theuser is specified by a position (coordinate) of the position P1 in thecapturing space, the direction of the frame F1 with respect to thereference direction, and the angle of view of the frame F1.

It is to be noted that the description here assumes that the number ofvisual points is three; however, the number of visual points may be oneand may be four or more. The live content distributed from thedistribution server 11 includes a video stream of the video capturedfrom one or more visual points. According to the visual point selectedby the user, the video stream reproduced in the client terminal isswitched.

Also, content of full free visual point generated by composition ofvideos captured at a plurality of positions may be distributed from thedistribution server 11. The content of full free visual point is contentthat allows selection of any position in the capturing space as thevisual point.

Returning to description of FIG. 1, the HMDs 21 to 24 each reproduce thelive content transmitted from the distribution server 11. The users ofthe HMDs 21 to 24 who are provided with the live content can also seethe scene almost identical to the scene the spectators in the eventvenue see.

The HMDs 21 to 24 each reproduce the live content and then cause abuilt-in display to display the video of the visual point selected bythe user. The HMDs 21 to 24 are each a so-called immersive HMD, andproject the video in front of eyes of the user who wears a body.

The HMDs 21 to 24 each detect a posture of the user's head duringreproduction of the live content, and switch the display range of thevideo according to the posture of the head. As described with referenceto FIG. 6, for example, when the user turns face rightward, the HMDs 21to 24 each move the display range of the video rightward while keepingthe position of the visual point as it is, and when the user turns faceleftward, the HMDs 21 to 24 each move the display range of the videoleftward while keeping the position of the visual point as it is.

In addition, during reproduction of the live content, the HMDs 21 to 24each detect a motion of the user on the basis of output from theacceleration sensor or angular velocity sensor. For example, the HMDs 21to 24 each detect a plurality of types of user motion, such as a degreeto which the user is swinging the head up and down, a degree to whichthe user is swaying the body, and whether the user is raising an arm.

The HMDs 21 to 24 each transmit motion information indicating the motionof the user who is watching the live content to the aggregation server12 together with information indicating an attribute of the user. Vitalsigns including a pulse, a heart rate, a body temperature, and othersigns of the user who is watching the live content detected by a sensorthe user wears on the body is also added to the motion information. Aswill be described later, the user attribute includes rough positionalinformation on the user, such as a position in district unit.

It can be said that the motion of the user while watching the livecontent indicates a degree of excitement of the user. Thus, theinformation processing system of FIG. 1 will acquire the degree ofexcitement of the user in a natural way without causing the user toperform active operations such as operating a button.

The aggregation server 12 receives the motion information and the userattribute information transmitted from the HMDs 21 to 24, and thenaggregates the degree of excitement, for example, in accordance with anaggregation method designated by the performers who are in the eventvenue. For example, conditions such as a method for determining thedegree of excitement based on motion and a method of arrangement ofinformation on each degree of excitement when visualizing the excitementinformation are designated as the aggregation method.

The aggregation server 12 determines the degree of excitement of theusers of the HMDs 21 to 24, that is, the degree of excitement of thespectators who are at distant location, on the basis of the motioninformation of the users of the HMDs 21 to 24.

The aggregation server 12 generates a heat map image that visualizes thedegree of excitement of all the spectators who are at distant location,and then transmits data of the heat map image to the display controlapparatus 2 installed in the event venue. The heat map image is an imageformed by arranging information that visually indicates the degree ofexcitement of each user at a position according to the attribute of eachuser.

The display control apparatus 2 receives the data transmitted from theaggregation server 12 and then causes the large display 3 to display theheat map image.

FIG. 7 is a diagram illustrating an example of the heat map image.

In the example of FIG. 7, the degree of excitement of each spectator whois at distant location is indicated by color. For example, when theperformers designate determination of the degree of excitement on thebasis of “intensity of the head motion”, higher degree of excitement isset and color with higher saturation and brightness is assigned to thespectator with higher-intensity head motion.

The heat map image of FIG. 7 is an image formed by arranging images ofpredetermined color indicating excitement of respective spectators atpositions corresponding to location information as the attributes ofrespective spectators.

For example, a region A1 of FIG. 7 is a region assigned to the user ofthe HMD 21 who is a spectator watching the live content in the Kantodistrict in Japan. The color of the region A1 indicates the degree ofexcitement of the user of the HMD 21. Also, a region A2 close to theregion A1 is a region assigned to the user of the HMD 22 who is aspectator similarly watching the live content in the Kanto district. Thecolor of the region A2 indicates the degree of excitement of the user ofthe HMD 22.

Also, a region A3 formed in a lower part is a region assigned to theuser of the HMD 23 who is a spectator watching the live content in theKyusyu district in Japan. The color of the region A3 indicates thedegree of excitement of the user of the HMD 23. Also, a region A4 formedin an upper right part is a region assigned to the user of the HMD 24who is a spectator watching the live content in the Hokkaido district inJapan. The color of the region A4 indicates the degree of excitement ofthe user of the HMD 24.

The region assigned to each user may be one pixel of the large display 3and may be a region including a plurality of pixels. Also, a shape ofthe region can be not only a square but also any shape such as a circle.

Thus, since the information indicating the degree of excitement of thespectators who are at distant location is displayed, the performers whoare in the event venue can realize the excitement of the spectators whoare at distant location, and can improve motivation.

Also, since the information indicating the excitement of the spectatorswho are at distant location is arranged and displayed at the positionsaccording to the attribute of each spectator, the performers canintuitively check spectators with which attribute are excited andspectators with which attribute are not. In the example of FIG. 7, theperformers can intuitively check in which district of Japan the usersare excited.

Also, since the performers can designate on the basis of what kind ofmotion to determine the degree of excitement, the performers can requestthe spectators who are at distant location to perform a predeterminedmotion, and can check how much the spectators react to the request. Theperformers can sequentially make an improvised request that, forexample, the spectators of each area should perform a motion such asswaying the body, and can obtain a sense of togetherness with thespectators who are at distant location through such a two-wayinteraction.

Also, the spectators who are in the event venue can share the excitementwith the spectators who are at distant location.

Meanwhile, the spectators who are at distant location can check theexcitement of the spectators who are at distant location includingthemselves by changing the line of sight or the like and watchingdisplay on the large display 3 inside the live content. In addition, thespectators who are at distant location can obtain experience withrealistic feeling by confirming that their excitement is conveyed to theperformers and the spectators who are in the event venue.

It is to be noted that the data of the heat map image is alsotransmitted from the aggregation server 12 to the HMDs 21 to 24 asappropriate. In the HMDs 21 to 24, the heat map image is displayedsuperimposed on the video of the live content.

A series of processing steps of displaying the heat map image asdescribed above will be described later.

<Configuration of Each Device>

Configuration of HMD

FIG. 8 is a block diagram illustrating a configuration example of theHMD 21.

The HMD 21 includes a communication unit 52, a sensor 53, a display 54,an operation unit 55, a speaker 56, and a storage unit 57, which areconnected to a control unit 51.

The control unit 51 includes elements such as a central processing unit(CPU), a read only memory (ROM), and a random access memory (RAM). Thecontrol unit 51 executes a predetermined program and controls an overalloperation of the HMD 21.

The communication unit 52 communicates with the distribution server 11and the aggregation server 12, for example, wirelessly. Thecommunication unit 52 receives the live content transmitted from thedistribution server 11 and then outputs the live content to the controlunit 51. In addition, the communication unit 52 transmits the motioninformation and the user attribute information supplied from the controlunit 51 to the aggregation server 12.

The sensor 53 includes a global positioning system (GPS) sensor, anangular velocity sensor, an acceleration sensor, and other sensors. Thesensor 53 performs positioning and detection of an angular velocity andacceleration during reproduction of the live content, and then outputssensor data to the control unit 51.

The display 54 includes an LCD, an organic EL display, or the like, anddisplays the video of the live content in accordance with controlperformed by the control unit 51.

The operation unit 55 includes operation buttons and the like providedon an enclosure surface of the HMD 21. Selection of the live content,selection of the visual point, and the like are performed using theoperation unit 55.

The speaker 56 outputs audio on the basis of audio data contained in thelive content supplied from the control unit 51 during reproduction ofthe live content.

The storage unit 57 includes a flash memory or a memory card insertedinto a card slot provided in the enclosure.

The HMDs 22 to 24 each have the configuration identical to theconfiguration of the HMD 21. The following description cites theconfiguration of FIG. 8 as the configuration of the HMDs 22 to 24 asappropriate.

FIG. 9 is a block diagram illustrating a configuration example of thecontrol unit 51.

At least part of functional units illustrated in FIG. 9 is implementedby a CPU of the control unit 51 executing a predetermined program. Asillustrated in FIG. 9, in the control unit 51, a live content receivingunit 91, a reproducing unit 92, a display control unit 93, a motiondetection unit 94, a motion information transmitting unit 95, and anattribute information management unit 96 are implemented. The sensordata that is output from the sensor 53 is input into the display controlunit 93 and the motion detection unit 94.

The live content receiving unit 91 controls the communication unit 52and receives the live content transmitted from the distribution server11. The live content receiving unit 91 outputs the received live contentto the reproducing unit 92.

The reproducing unit 92 reproduces the live content supplied from thelive content receiving unit 91. The reproducing unit 92 decodes, forexample, the video stream of the video of the visual point selected bythe user contained in the live content, and then outputs data obtainedby decoding the video stream to the display control unit 93.

The display control unit 93 causes the display 54 to display the videoof the predetermined visual field of the live content on the basis ofthe data supplied from the reproducing unit 92. In addition, duringreproduction of the live content, the display control unit 93 identifiesthe visual field of the user on the basis of the sensor data, such as anangular velocity and acceleration, and then switches the display rangeof the video. Information indicating the visual field of the user issupplied to the attribute information management unit 96.

The motion detection unit 94 detects a plurality of types of user motionduring reproduction of the live content on the basis of the sensor datasuch as an angular velocity and acceleration. The motion detection unit94 outputs the motion information indicating the detected motion to themotion information transmitting unit 95. Vital signs including a pulse,a heart rate, a body temperature, and other signs are added to themotion information.

The motion information transmitting unit 95 controls the communicationunit 52 and transmits the motion information supplied from the motiondetection unit 94 and the user attribute information read from theattribute information management unit 96 to the aggregation server 12.Transmission of the motion information and the user attributeinformation is repeatedly performed, for example, during reproduction ofthe live content.

The attribute information management unit 96 manages the user attributeinformation and outputs the user attribute information to the motioninformation transmitting unit 95 as appropriate.

FIG. 10 is a diagram illustrating an example of information included inthe user attribute information.

The user attribute information includes location information, favoriteinformation, and visual field information.

The location information is information indicating rough location, suchas a district unit. The location information may be acquired on thebasis of positioning results performed by the GPS sensor thatconstitutes the sensor 53, and may be input by the user.

The favorite information is information indicating a favorite personreflected in the live content the user is watching. The favoriteinformation may be selected from a list of performers at a time ofstarting watching of the live content, or the favorite information maybe specified by the attribute information management unit 96 on thebasis of the visual field of the user. In this case, for example, theattribute information management unit 96 identifies a time period and aposition of each performer reflected in the visual field of the user.The attribute information management unit 96 then specifies theperformer who is reflected for a longer time in the visual field of theuser and reflected at a position close to a center of the visual fieldas the favorite person of the user.

The visual field information is information indicating the visual fieldof the user identified on the basis of the sensor data such as anangular velocity and acceleration. As described above, the visual fieldof the user is identified by using a position of the visual point, adirection of the line of sight, and the angle of view of the display 54.Where in the event venue the user sees is identified by using the visualfield information.

The user attribute information can include at least one of various typesof information, such as the user's national origin, hobby, area ofexpertise, gender, and user ID. The user attribute information includesat least one of a plurality of types of information.

Configuration of Server

FIG. 11 is a block diagram illustrating a configuration example of theaggregation server 12.

A CPU 101, a ROM 102, and a RAM 103 are connected to one another via abus 104. An input/output interface 105 is also connected to the bus 104.A display 106 and an input unit 107 are connected to the input/outputinterface 105. The input unit 107 is a keyboard, a mouse, or the like,and is used by an administrator of the aggregation server 12.

In addition, a recording unit 108 including a hard disk, a nonvolatilememory, or the like, and a communication unit 109, which is a networkinterface and communicates with other devices via the network, areconnected to the input/output interface 105. A drive 110 that drives aremovable medium 111 is also connected to the input/output interface105.

FIG. 12 is a block diagram illustrating a functional configurationexample of the aggregation server 12.

At least part of functional units illustrated in FIG. 12 is implementedby the CPU 101 executing a predetermined program. As illustrated in FIG.12, in the aggregation server 12, a motion information receiving unit121, a motion information recording unit 122, an excitement aggregationunit 123, a designation information receiving unit 124, and a heat mapimage transmitting unit 125 are implemented.

The motion information receiving unit 121 controls the communicationunit 109 and receives the motion information and the user attributeinformation transmitted from the HMDs 21 to 24. The motion informationreceiving unit 121 causes the motion information recording unit 122 torecord the received motion information and the user attributeinformation.

The motion information recording unit 122 records the motion informationand the user attribute information. The motion information and the userattribute information recorded in the motion information recording unit122 are read by the excitement aggregation unit 123 as appropriate.

The excitement aggregation unit 123 reads the motion information and theuser attribute information from the motion information recording unit122. The excitement aggregation unit 123 then aggregates the degree ofexcitement of the spectators who are at distant location in accordancewith the aggregation method designated by the performers who are in theevent venue. The vital signs added to the motion information are alsoused for determining the degree of excitement as appropriate.

As described above, the method for determining the degree of excitementbased on the motion, the method of arrangement of the information oneach degree of excitement when visualizing the excitement information,and the like are designated by the performers. The aggregation methoddesignated by the performers is indicated by aggregation methoddesignation information supplied from the designation informationreceiving unit 124.

For example, when the method for determining the degree of excitement isdesignated on the basis of whether the head is shaken intensely, theexcitement aggregation unit 123 determines the degree of excitement ofeach user on the basis of the degree to which the user is shaking thehead up and down which is indicated using the motion information.

In addition, when the method for determining the degree of excitement isdesignated on the basis of whether the user is in rhythm, the excitementaggregation unit 123 determines the degree of excitement of each user onthe basis of the degree to which the user is swaying the body which isindicated using the motion information.

Specifically, the excitement aggregation unit 123 applies Fouriertransform or wavelet transform to information indicating the motion ofthe user head or the motion of the user body to perform frequencyconversion. The excitement aggregation unit 123 determines the degree ofexcitement of each user by applying calculation using a predeterminedfunction, such as an identity function, step function, and sigmoidfunction, to a value obtained by performing frequency conversion and avalue such as a heart rate, body temperature, and the like indicated bythe vital signs.

The excitement aggregation unit 123 generates the heat map image byarranging the information that visually indicates the degree ofexcitement of each user determined in this way by the method designatedby the performers who are in the event venue with reference to the userattribute information.

For example, the excitement aggregation unit 123 divides the informationthat visually indicates the degree of excitement of each user intogroups each of which includes the degrees of excitement of the users ofan identical area. The excitement aggregation unit 123 then arrangeseach group together on the heat map image. The location informationincluded in the user attribute information indicates in which area eachuser is.

Thus, the excitement aggregation unit 123 visualizes the excitementinformation on the spectators who are at distant location, and thenoutputs the data of the heat map image to the heat map imagetransmitting unit 125.

The designation information receiving unit 124 controls thecommunication unit 109 and receives the aggregation method designationinformation transmitted from the display control apparatus 2. Thedesignation information receiving unit 124 outputs the receivedaggregation method designation information to the excitement aggregationunit 123.

The heat map image transmitting unit 125 controls the communication unit109 and transmits the data of the heat map image supplied from theexcitement aggregation unit 123 to the display control apparatus 2. Theheat map image transmitting unit 125 also transmits the data of the heatmap image to the HMDs 21 to 24 as appropriate.

It is to be noted that the distribution server 11 also has theconfiguration identical to the configuration of the aggregation server12 illustrated in FIG. 11. The following description cites theconfiguration of FIG. 11 as the configuration of the distribution server11 as appropriate.

FIG. 13 is a block diagram illustrating a functional configurationexample of the distribution server 11.

At least part of functional units illustrated in FIG. 13 is implementedby the CPU 101 of the distribution server 11 (FIG. 11) executing apredetermined program. As illustrated in FIG. 13, in the distributionserver 11, a moving picture acquisition unit 131, alive contentgeneration unit 132, and a distribution unit 133 are implemented.

The moving picture acquisition unit 131 controls the communication unit109 and receives the moving picture of each visual point transmittedfrom the capturing control apparatus 1. The moving picture acquisitionunit 131 outputs data of the received moving picture to the live contentgeneration unit 132.

The live content generation unit 132 generates the live content fordistribution on the basis of the data of the moving picture suppliedfrom the moving picture acquisition unit 131, and then outputs the livecontent for distribution to the distribution unit 133.

The distribution unit 133 controls the communication unit 109 anddistributes the live content generated by the live content generationunit 132 to the HMDs 21 to 24.

Configuration of Display Control Apparatus

FIG. 14 is a block diagram illustrating a configuration example of thedisplay control apparatus 2.

A CPU 141, a ROM 142, and a RAM 143 are connected to one another via abus 144. An input/output interface 145 is also connected to the bus 144.The large display 3 is connected to the input/output interface 145. Inaddition, an input unit 146 operated by an administrator of the displaycontrol apparatus 2, such as a keyboard and a mouse, is connected to theinput/output interface 145.

A recording unit 147 including a hard disk, a nonvolatile memory, andthe like, and a communication unit 148 that communicates with otherdevices via a network are also connected to the input/output interface145.

FIG. 15 is a block diagram illustrating a functional configurationexample of the display control apparatus 2.

At least part of functional units illustrated in FIG. 15 is implementedby the CPU 141 executing a predetermined program. As illustrated in FIG.15, in the display control apparatus 2, a heat map image receiving unit161, a display control unit 162, an aggregation method acquisition unit163, and a designation information transmitting unit 164 areimplemented.

The heat map image receiving unit 161 controls the communication unit148 and receives the data of the heat map image transmitted from theaggregation server 12. The heat map image receiving unit 161 outputs thedata of the heat map image to the display control unit 162.

The display control unit 162 causes the large display 3 to display theheat map image on the basis of the data supplied from the heat map imagereceiving unit 161.

The aggregation method acquisition unit 163 controls the communicationunit 148 and communicates with, for example, the portable terminals theperformers have. The aggregation method acquisition unit 163 receivesthe aggregation method designation information transmitted from theportable terminals, the aggregation method designation informationdesignating the aggregation method of the degree of excitement of theusers who are at distant location. The aggregation method acquisitionunit 163 outputs the received aggregation method designation informationto the designation information transmitting unit 164. The designation ofthe aggregation method may not be performed by the performers but may beperformed by an operator of the concert.

The designation information transmitting unit 164 controls thecommunication unit 148 and transmits the aggregation method designationinformation supplied from the aggregation method acquisition unit 163 tothe aggregation server 12.

<Operation of Each Device>

Here, an operation of each device having the aforementionedconfiguration will be described.

First, with reference to a flowchart of FIG. 16, processing of thedistribution server 11 that distributes the live content will bedescribed.

The processing of FIG. 16 starts when the concert starts in the eventvenue and the moving picture of the event venue is transmitted from thecapturing control apparatus 1.

In step S1, the moving picture acquisition unit 131 receives the movingpicture of each visual point transmitted from the capturing controlapparatus 1.

In step S2, the live content generation unit 132 generates the livecontent for distribution on the basis of the moving picture received bythe moving picture acquisition unit 131.

In step S3, the distribution unit 133 distributes the live contentgenerated by the live content generation unit 132 to the HMDs 21 to 24.When the distribution of the live content ends, the distribution unit133 ends the processing.

Next, with reference to a flowchart of FIG. 17, processing of the clientterminal that reproduces the live content will be described. While thedescription is made here on an assumption that the HMD 21 performs theprocessing, similar processing is also performed in the HMDs 22 to 24.

In step S11, the live content receiving unit 91 receives the livecontent transmitted from the distribution server 11.

In step S12, the reproducing unit 92 reproduces the live contentreceived by the live content receiving unit 91.

In step S13, the display control unit 93 causes the display 54 todisplay the video according to the visual field of the user on the basisof the data obtained by decoding the video stream of the video of apredetermined visual point. In addition, the display control unit 93identifies the visual field of the user on the basis of the sensor data,and then switches the display range of the video. The visual fieldinformation indicating the visual field of the user is included in theuser attribute information and is managed by the attribute informationmanagement unit 96.

In step S14, the motion detection unit 94 detects a plurality of typesmotion of the user on the basis of the sensor data.

In step S15, the motion information transmitting unit 95 adds the vitalsigns to the motion information indicating the motion of the userdetected by the motion detection unit 94. The motion informationtransmitting unit 95 then transmits the motion information and the vitalsigns to the aggregation server 12 together with the user attributeinformation read from the attribute information management unit 96.

In step S16, the reproducing unit 92 determines whether the reproductionends. When the reproducing unit 92 determines in step S16 that thereproduction does not end, the processing returns to step S11, and thesubsequent processing will be performed.

On the other hand, when the reproducing unit 92 determines in step S16that the reproduction ends for a reason that the live content has beenreproduced to the end or other reasons, the reproducing unit 92 ends theprocessing.

Next, with reference to a flowchart of FIG. 18, processing of theaggregation server 12 that aggregates the excitement of the spectatorswho are at distant location will be described.

In step S21, the motion information receiving unit 121 receives themotion information and the user attribute information transmitted fromthe HMDs 21 to 24.

In step S22, the motion information recording unit 122 associates themotion information with the user attribute information, and records themotion information and the user attribute information

In step S23, the designation information receiving unit 124 receives theaggregation method designation information transmitted from the displaycontrol apparatus 2.

In step S24, the excitement aggregation unit 123 aggregates the degreeof excitement of the spectators who are at distant location inaccordance with the aggregation method designated by the performers. Theexcitement aggregation unit 123 then generates the heat map image.

In step S25, the heat map image transmitting unit 125 transmits the dataof the heat map image to the display control apparatus 2.

In step S26, the heat map image transmitting unit 125 transmits the dataof the heat map image to the HMDs 21 to 24, and then ends theprocessing.

For example, every time the aggregation method is designated by theperformers, the processing of FIG. 18 is performed, and the heat mapimage is transmitted to the display control apparatus 2. Every time theperformers designate the aggregation method, the performers can switchdisplay of the heat map image.

Next, with reference to a flowchart of FIG. 19, processing of thedisplay control apparatus 2 that displays the heat map image will bedescribed.

In step S41, the aggregation method acquisition unit 163 receives theaggregation method designation information transmitted from the portableterminals the performers have.

In step S42, the designation information transmitting unit 164 transmitsthe aggregation method designation information received by theaggregation method acquisition unit 163 to the aggregation server 12. Inthe aggregation server 12, the processing of FIG. 18 is performed andthe data of the heat map image is transmitted to the display controlapparatus 2.

In step S43, the heat map image receiving unit 161 determines whetherthe data of the heat map image has been transmitted from the aggregationserver 12. The heat map image receiving unit 161 stands by untildetermination is made that the data has been transmitted.

When the determination is made in step S43 that the data of the heat mapimage has been transmitted from the aggregation server 12, in step S44,the heat map image receiving unit 161 receives the data of the heat mapimage.

In step S45, the display control unit 162 causes the large display 3 todisplay the heat map image on the basis of the data received by the heatmap image receiving unit 161.

By seeing the heat map image displayed on the large display 3, theperformers and the spectators who are in the event venue, and thespectators who are at distant location can share an atmosphere of theconcert.

Next, with reference to a flowchart of FIG. 20, processing of the HMD 21as the client terminal that displays the heat map image will bedescribed.

The processing of FIG. 20 starts, for example, when display of the heatmap image is instructed while the live content is watched. When displayof the heat map image is instructed, the aggregation method of thedegree of excitement is designated by the user.

Thus, the users of the HMDs 21 to 24 can also designate the aggregationmethod of the degree of excitement. The processing described withreference to FIG. 18 is performed by the aggregation server 12 inaccordance with the aggregation method designated by the users of theHMDs 21 to 24, and then the heat map image is transmitted, for example,to the HMD 21.

In step S51, the communication unit 52 transmits the aggregation methoddesignation information that designates the aggregation methoddesignated by the user to the aggregation server 12.

In step S52, the communication unit 52 determines whether the data ofthe heat map image has been transmitted from the aggregation server 12.The communication unit 52 stands by until the determination is made thatthe data has been transmitted.

When the determination is made in step S52 that the data of the heat mapimage has been transmitted from the aggregation server 12, in step S53,the communication unit 52 receives the data of the heat map image. Thedata of the heat map image is supplied to the display control unit 93via a path which is not illustrated.

In step S54, the display control unit 93 causes the display 54 todisplay the heat map image superimposed on the video of the livecontent.

FIG. 21 is a diagram illustrating a display example of the display 54.

In the example of FIG. 21, a heat map image P superimposed on the videoof the live content is displayed in an upper right of the display 54.The user of the HMD 21 can check the degree of excitement of thespectators who are at distant location by seeing the heat map imagegenerated in accordance with the aggregation method specified by theuser.

By a series of the aforementioned processing steps, the aggregationserver 12 can acquire the excitement information on the spectators whoare at distant location in a more natural way without causing the userswho are watching the live content to perform active operations. Inaddition, by transmitting the heat map image that visualizes theexcitement information to the event venue and causing the large display3 to display the heat map image, the aggregation server 12 can presentthe degree of excitement of the spectators who are at distant locationto the performers and the spectators in an easier-to-see way.

<Example of Heat Map Image>

As described above, the performers can switch display of the heat mapimage by designating the aggregation method.

FIG. 22 is a diagram illustrating another example of the heat map image.

The heat map image of FIG. 22 is an image made by arranging a shade ofcolor indicating the degree of excitement outward from a center indecreasing order of the degree of excitement. The degree of excitementis determined, for example, on the basis of “intensity of motion of thehead.”

The performers can change the heat map image of FIG. 7 to display ofFIG. 22, for example, by designating the aggregation method.

The shade of color may be arranged at a position according to a user IDas the attribute of each user.

Also, the heat map image may be displayed with the informationindicating the degree of excitement of each national origin of the userarranged together as illustrated in FIG. 23, instead of each area insideJapan.

In the example of FIG. 23, the information indicating the degree ofexcitement of the users from the United States indicated by theirattribute is arranged in an upper left region of the large display 3. Inaddition, the information indicating the degree of excitement of theusers from India is arranged in a lower left region of the large display3.

Thus, the performers can designate various methods as the method forarranging the information indicating the degree of excitement of eachuser.

For example, it is also possible to arrange together the informationindicating the degree of excitement of the users who have a commonfavorite performer.

When the performers are persons H1, H2, and H3, the informationindicating the degree of excitement of the user who likes the person H1,the information indicating the degree of excitement of the user wholikes the person H2, and the information indicating the degree ofexcitement of the user who likes the person H3 are each collected anddisplayed in a predetermined region. Which performer each user likes isindicated by the favorite information included in the user attributeinformation.

This allows each performer to check the degree of excitement of fans ofthe performer.

In addition, it is also possible to arrange together the informationindicating the degree of excitement of the users who see a common range.

When the performers are persons H1, H2, and H3, the informationindicating the degree of excitement of the user who sees the person H1,the information indicating the degree of excitement of the user who seesthe person H2, and the information indicating the degree of excitementof the user who sees the person H3 are each collected and displayed in apredetermined region. Where each user sees is indicated by the visualfield information included in the user attribute information.

FIG. 24 is a diagram illustrating an example of switching display of theheat map image.

The heat map image illustrated on a left side of FIG. 24 is an imageidentical to the heat map image described with reference to FIG. 7. Forexample, when the performers select a region A11 and designateenlargement of the degree of excitement, the display control apparatus 2enlarges and displays the information indicating the degree ofexcitement of the users assigned to the region A11 as illustrated on aright side of FIG. 24.

The display control apparatus 2 displays, for example, human-shapedicons as information that visually indicates the degree of excitement ofthe users. The human-shaped icons are displayed in color according tothe degree of excitement.

Thus, when the degree of excitement of the large number of spectators isdisplayed collectively, the region assigned to each spectator in theentire large display 3 becomes relatively small. Conversely, when thedegree of excitement of the small number of spectators is displayed, theregion assigned to each spectator becomes relatively large; at thistime, the method for representing the degree of excitement can bechanged. Thus, the information indicating the degree of excitement maybe any information if the information can be checked visually.

By operating the portable terminals the performers have, the performerscan select the region in which the degree of excitement is displayed,and can display enlarged information or reduced information indicatingthe degree of excitement.

<Variations>

The foregoing has described the examples in which the HMD is used as theclient terminal; various devices having displays, such as a smartphoneand a tablet terminal, can also be used as the client terminal.

During reproduction of the live content, the smartphone or tabletterminal as the client terminal detects the visual field of the user onthe basis of the sensor data from an acceleration sensor or angularvelocity sensor mounted thereon, and switches the display range of thevideo. Also, the smartphone or tablet terminal detects the motion of theuser by analyzing an image of the user captured with a camera or on thebasis of the sensor data, and then transmits the motion information tothe aggregation server 12.

In addition, the smartphone or tablet terminal can also detect themotion of the user on the basis of various operations such as anoperation of repeatedly rubbing a display surface and an operation ofrepeatedly pushing a button displayed on the display. The display of thesmartphone or tablet terminal is provided with a stacked touch panel,enabling detection of the operation of the user applied to the display.

Example of Content

The foregoing has described a case where the video obtained by capturinga state of the concert is distributed as the live content; it is alsopossible to distribute a video obtained by capturing a state of alecture.

In this case, during reproduction of the live content, for example, theHMDs 21 to 24 each detect whether the user as a student taking thelecture is dozing on the basis of the sensor data, and then transmitdetected information as the motion information to the aggregation server12 together with the user attribute information. The aggregation server12 identifies the dozing user, generates a map image indicating of whichattribute the user is sleeping, and then transmits the map image to thedisplay control apparatus 2. The display control apparatus 2 causes thelarge display 3 to display the map image.

This allows a person as a teacher of the lecture to easily check ofwhich attribute the user is sleeping.

Thus, the above-described technology can be applied to real timedistribution of various moving pictures.

Also, in the foregoing, it is assumed that the content distributed isfree visual point content; however, content of a normal moving picturewith an unchangeable visual point or visual field may be distributed.

About Form of HMD

The description has been made on an assumption that the HMDs 21 to 24are immersive HMDs; the above-described technology can be applied toso-called video see-through type HMDs and optical see-through type HMDsas well.

FIGS. 25A, 25B and 25C are diagrams illustrating an example of a form ofthe HMD.

As illustrated in FIG. 25B, the video see-through type HMD is identicalto the immersive HMD in that the display is provided at a position wherethe video is projected in front of eyes of the user who wears a body.However, the video see-through type HMD is different from the immersiveHMD in that a camera is provided in an enclosure of the HMD and a videoof a scene ahead of the user captured with the camera is displayed onthe display.

As illustrated in FIG. 25C, the optical see-through type HMD is an HMDwith a half mirror provided in front of the eyes of the user who wearsthe HMD, which allows the user to see the scene ahead through the halfmirror. Light of various types of information, such as the video of thelive content, that is output from a light-emitting part provided in asection such as a frame section of the HMD is reflected by the halfmirror and then guided to the eyes of the user. The user can see varioustypes of information superimposed on the scene in front of the eyes.

About Program

A series of processing steps described above can be performed byhardware, and can be performed by software. When the series ofprocessing steps is performed by software, a program that constitutesthe software is installed in a computer built into dedicated hardware, ageneral-purpose personal computer, or the like.

The program to be installed is recorded and provided in the removablemedium 111 illustrated in FIG. 11 including an optical disc (such as acompact disc-read only memory (CD-ROM) and a digital versatile disc(DVD)), a semiconductor memory, and the like. In addition, the programto be installed may be provided via a wired or wireless transmissionmedium, such as a local area network, the Internet, and digitalbroadcasting. The program can be installed in the ROM 102 or therecording unit 108 in advance.

It is to be noted that the program to be executed by the computer may bea program that performs processing on a time-series basis in orderdescribed in the present specification, or may be a program thatperforms processing in parallel or at necessary timing such as whencalled.

It is to be noted that in the present specification, the system means aset of a plurality of components (apparatus, module (part), and thelike), and it does not matter whether all the components are inside thesame enclosure. Therefore, a plurality of apparatuses which arecontained in separate enclosures and connected via a network, and oneapparatus with an enclosure that contains a plurality of modules are allsystems.

The embodiment of the present technology is not limited to theabove-described embodiment, and various changes can be made withoutdeparting from the spirit of the present technology.

For example, the present technology can have a configuration of cloudcomputing in which one function is divided among a plurality ofapparatuses and is jointly processed via a network.

Also, each step described in the aforementioned flowcharts can beperformed by one apparatus, and can also be performed by dividing thestep among a plurality of apparatuses.

Furthermore, when one step includes a plurality of processing steps, theplurality of processing steps included in the one step can be performedby one apparatus, and can also be performed by dividing the processingsteps among the plurality of apparatuses.

Effects described in the present specification are only illustrative andnot restrictive, and other effects may be obtained.

<Example of Combination of Configurations>

The present technology can also have the following configurations.

-   (1)

An information processing apparatus including:

a receiving unit configured to receive motion information indicating amotion of a user who is watching video content and informationindicating an attribute of the user transmitted from a reproducingapparatus that receives and reproduces the real time video content witha display range switched following the motion of the user who is aviewer within a range of a captured entire video;

a generation unit configured to generate an excitement image byarranging information that visually indicates a degree of excitement ofeach of the users determined on the basis of the motion informationtransmitted from the plurality of reproducing apparatuses at a positionaccording to the attribute of each of the users; and

a transmitting unit configured to transmit data of the excitement imageto a display control apparatus that causes a display apparatus installedin space where capturing of the video of the video content is performedto display the excitement image.

-   (2)

The information processing apparatus according to (1), wherein thegeneration unit generates the excitement image with a color according tothe degree of excitement of the user arranged at the position accordingto the attribute of the user.

-   (3)

The information processing apparatus according to (1), wherein thegeneration unit generates the excitement image with an icon according tothe degree of excitement of the user arranged at the position accordingto the attribute of the user.

-   (4)

The information processing apparatus according to any of (1) to (3),wherein the attribute of the user is at least one of a position of theuser who is watching the video content, a favorite person of the useramong a plurality of persons reflected in the video, and a visual fieldof the user corresponding to the display range.

-   (5)

The information processing apparatus according to any of (1) to (4),wherein

the receiving unit receives designation information transmitted from thedisplay control apparatus, the designation information indicating amethod for determining the degree of excitement based on the motioninformation and a method for arranging the information that visuallyindicates the degree of excitement, and

the generation unit generates the excitement image by determining thedegree of excitement in accordance with the method for determinationindicated by the designation information and by arranging theinformation that visually indicates the degree of excitement inaccordance with the method indicated by the designation information.

-   (6)

The information processing apparatus according to (5), wherein themethod for determining the degree of excitement and the method forarranging the information that visually indicates the degree ofexcitement are designated by a person reflected in the video.

-   (7)

An information processing method including the steps of:

receiving motion information indicating a motion of a user who iswatching video content and information indicating an attribute of theuser transmitted from a reproducing apparatus that receives andreproduces the real time video content with a display range switchedfollowing the motion of the user who is a viewer within a range of acaptured entire video;

generating an excitement image by arranging information that visuallyindicates a degree of excitement of each of the users determined on thebasis of the motion information transmitted from the plurality ofreproducing apparatuses at a position according to the attribute of eachof the users; and

transmitting data of the excitement image to a display control apparatusthat causes a display apparatus installed in space where capturing ofthe video of the video content is performed to display the excitementimage.

-   (8)

A program for causing a computer to perform processing including thesteps of:

receiving motion information indicating a motion of a user who iswatching video content and information indicating an attribute of theuser transmitted from a reproducing apparatus that receives andreproduces the real time video content with a display range switchedfollowing the motion of the user who is a viewer within a range of acaptured entire video;

generating an excitement image by arranging information that visuallyindicates a degree of excitement of each of the users determined on thebasis of the motion information transmitted from the plurality ofreproducing apparatuses at a position according to the attribute of eachof the users; and

transmitting data of the excitement image to a display control apparatusthat causes a display apparatus installed in space where capturing ofthe video of the video content is performed to display the excitementimage.

-   (9)

A display control apparatus including:

a receiving unit configured to receive motion information indicating amotion of a user who is watching video content and informationindicating an attribute of the user transmitted from a reproducingapparatus that receives and reproduces the real time video content witha display range switched following the motion of the user who is aviewer within a range of a captured entire video, and to receive data ofan excitement image transmitted from an information processing apparatusthat generates the excitement image by arranging information thatvisually indicates a degree of excitement of each of the usersdetermined on the basis of the motion information transmitted from theplurality of reproducing apparatuses at a position according to theattribute of each of the users; and

a display control unit configured to cause a display apparatus installedin space where capturing of the video of the video content is performedto display the excitement image on the basis of the data of theexcitement image.

-   (10)

The display control apparatus according to (9), wherein

the receiving unit receives designation information designated by aperson reflected in the video, the designation information indicating amethod for determining the degree of excitement based on the motioninformation and a method for arranging the information that visuallyindicates the degree of excitement, and

the display control apparatus further includes a transmitting unitconfigured to transmit the designation information to the informationprocessing apparatus.

-   (11)

A display control method including the steps of:

receiving motion information indicating a motion of a user who iswatching video content and information indicating an attribute of theuser transmitted from a reproducing apparatus that receives andreproduces the real time video content with a display range switchedfollowing the motion of the user who is a viewer within a range of acaptured entire video, and to receive data of an excitement imagetransmitted from an information processing apparatus that generates theexcitement image by arranging information that visually indicates adegree of excitement of each of the users determined on the basis of themotion information transmitted from the plurality of reproducingapparatuses at a position according to the attribute of each of theusers; and

causing a display apparatus installed in space where capturing of thevideo of the video content is performed to display the excitement imageon the basis of the data of the excitement image.

-   (12)

A program for causing a computer to perform processing including thesteps of:

receiving motion information indicating a motion of a user who iswatching video content and information indicating an attribute of theuser transmitted from a reproducing apparatus that receives andreproduces the real time video content with a display range switchedfollowing the motion of the user who is a viewer within a range of acaptured entire video, and to receive data of an excitement imagetransmitted from an information processing apparatus that generates theexcitement image by arranging information that visually indicates adegree of excitement of each of the users determined on the basis of themotion information transmitted from the plurality of reproducingapparatuses at a position according to the attribute of each of theusers; and

causing a display apparatus installed in space where capturing of thevideo of the video content is performed to display the excitement imageon the basis of the data of the excitement image.

-   (13)

A reproducing apparatus including:

a receiving unit configured to receive real time video content with adisplay range switched following a motion of a user who is a viewerwithin a range of a captured entire video;

a reproducing unit configured to reproduce the video content;

a detection unit configured to detect the motion of the user;

a display unit configured to display the video of the display rangeaccording to the motion of the user; and

a transmitting unit configured to transmit motion information indicatingthe motion of the user who is watching the video content to aninformation processing apparatus that aggregates the motion informationtogether with information indicating an attribute of the user.

-   (14)

The reproducing apparatus according to (13), wherein the motiondetection unit detects a plurality of types of motion of the user.

-   (15)

A reproducing method including the steps of:

receiving real time video content with a display range switchedfollowing a motion of a user who is a viewer within a range of acaptured entire video;

reproducing the video content;

detecting the motion of the user;

displaying the video of the display range according to the motion of theuser; and

transmitting motion information indicating the motion of the user who iswatching the video content to an information processing apparatus thataggregates the motion information together with information indicatingan attribute of the user.

-   (16)

A program for causing a computer to perform processing including thesteps of:

receiving real time video content with a display range switchedfollowing a motion of a user who is a viewer within a range of acaptured entire video;

reproducing the video content;

detecting the motion of the user;

displaying the video of the display range according to the motion of theuser; and

transmitting motion information indicating the motion of the user who iswatching the video content to an information processing apparatus thataggregates the motion information together with information indicatingan attribute of the user.

-   (17)

An information processing system including:

a reproducing apparatus including:

a receiving unit configured to receive real time video content with adisplay range switched following a motion of a user who is a viewerwithin a range of a captured entire video;

a reproducing unit configured to reproduce the video content;

a detection unit configured to detect the motion of the user;

a display unit configured to display the video of the display rangeaccording to the motion of the user; and

a transmitting unit configured to transmit motion information indicatingthe motion of the user who is watching the video content to aninformation processing apparatus that aggregates the motion informationtogether with information indicating an attribute of the user,

the information processing apparatus including:

a receiving unit configured to receive the motion information and theinformation indicating the attribute of the user transmitted from thereproducing apparatuses;

a generation unit configured to generate an excitement image byarranging information that visually indicates a degree of excitement ofeach of the users determined on the basis of the motion informationtransmitted from the plurality of reproducing apparatuses at a positionaccording to the attribute of each of the users; and

a transmitting unit configured to transmit data of the excitement imageto a display control apparatus that causes a display apparatus installedin space where capturing of the video of the video content is performedto display the excitement image, and

the display control apparatus including:

a receiving unit configured to receive the data of the excitement imagetransmitted from the information processing apparatus; and

a display control unit configured to cause the display apparatusinstalled in the space where the capturing of the video of the videocontent is performed to display the excitement image on the basis of thedata of the excitement image.

REFERENCE SIGNS LIST

-   1 Capturing control apparatus-   2 Display control apparatus-   3 Large display-   11 Distribution server-   12 Aggregation server-   21 to 24 HMD-   121 Motion information receiving unit-   122 Motion information recording unit-   123 Excitement aggregation unit-   124 Designation information receiving unit-   125 Heat map image transmitting unit

The invention claimed is:
 1. An information processing apparatus,comprising: a receiving unit configured to receive, from each of aplurality of reproducing apparatuses, first motion information andattribute information, wherein the first motion information indicates amotion of each user of a plurality of users, the attribute informationindicates an attribute of each user of the plurality of users, the firstmotion information is different from the attribute information, each ofthe plurality of reproducing apparatuses is associated with a respectiveuser of the plurality of users, and each of the plurality of reproducingapparatuses: receives video content of a video corresponding to anevent; reproduces the video content; and switches a display range of thevideo content within an entire range of the video based on the motion ofthe respective user; a generation unit configured to: determine a degreeof excitement of each user of the plurality of users based on the firstmotion information; determine color information based on the attributeof each user of the plurality of users, wherein the color informationindicates the degree of excitement of the plurality of users; andgenerate a heat map image associated with the event, wherein the heatmap image is generated based on the degree of excitement of each user ofthe plurality of users, the heat map image includes an arrangement ofthe color information, and the arrangement of the color information inthe heat map image is based on a division of the color information; anda transmitting unit configured to transmit the heat map image to adisplay control apparatus, wherein the display control apparatuscontrols a display screen to display the heat map image, and the displayscreen is in a space where the video is captured.
 2. The informationprocessing apparatus according to claim 1, wherein the generation unitis further configured to generate the heat map image by the arrangementof the color information at a plurality of positions in the heat mapimage.
 3. The information processing apparatus according to claim 1,wherein the generation unit is further configured to generate the heatmap image by arrangement of a plurality of icons, and each of theplurality of icons indicates the degree of excitement of the respectiveuser of the plurality of users.
 4. The information processing apparatusaccording to claim 1, wherein the attribute of each user of theplurality of users is one of a position of the respective user of theplurality of users, a favorite person of the respective user among aplurality of persons reflected in the video, or a visual field, of therespective user, that corresponds to the display range.
 5. Theinformation processing apparatus according to claim 1, wherein thereceiving unit is further configured to: receive second motioninformation from the plurality of reproducing apparatuses, wherein thesecond motion information indicates a plurality of motions of theplurality of users; and receive designation information from the displaycontrol apparatus, wherein the designation information indicates: amethod to determine the degree of excitement of each of the plurality ofusers based on a specific motion, of the plurality of motions, of eachof the plurality of users; and a method to arrange the color informationthat indicates the degree of excitement, and the generation unit isfurther configured to: determine the degree of excitement based on thedesignation information; and arrange the color information based on thedesignation information.
 6. The information processing apparatusaccording to claim 5, wherein the designation information is associatedwith a person reflected in the video.
 7. The information processingapparatus according to claim 1, wherein the attribute of each user ofthe plurality of users corresponds to a favorite person among aplurality of persons, the plurality of persons is associated with thevideo of the event, and a determination of the favorite person is basedon a visual field of the respective user.
 8. An information processingmethod, comprising: receiving, from each of a plurality of reproducingapparatuses, motion information and attribute information, wherein themotion information indicates a motion of each user of a plurality ofusers, the attribute information indicates an attribute of each user ofthe plurality of users, the motion information is different from theattribute information, each of the plurality of reproducing apparatusesis associated with a respective user of the plurality of users, and eachof the plurality of reproducing apparatuses: receives video content of avideo corresponding to an event; reproduces the video content; andswitches a display range of the video content within an entire range ofthe video based on the motion of the respective user; determining adegree of excitement of each user of the plurality of users based on themotion information; determining color information based on the attributeof each user of the plurality of users, wherein the color informationindicates the degree of excitement of the plurality of users; generatinga heat map image associated with the event, wherein the heat map imageis generated based on the degree of excitement of each user of theplurality of users, the heat map image includes an arrangement of thecolor information, and the arrangement of the color information in theheat map image is based on a division of the color information; andtransmitting the heat map image to a display control apparatus, whereinthe display control apparatus controls a display screen to display theheat map image, and the display screen is in a space where the video iscaptured.
 9. A non-transitory computer-readable medium having storedthereon computer-readable instructions that, when executed by aprocessor, cause the processor to execute operations, the operationscomprising: receiving, from a plurality of reproducing apparatuses,motion information and attribute information, wherein the motioninformation indicates a motion of each user of a plurality of users, theattribute information indicates an attribute of each user of theplurality of users, the motion information is different from theattribute information, each of the plurality of reproducing apparatusesis associated with a respective user of the plurality of users, and eachof the plurality of reproducing apparatuses: receives video content of avideo corresponding to an event; reproduces the video content; andswitches a display range of the video content within an entire range ofthe video based on the motion of the respective user; determining adegree of excitement of each user of the plurality of users based on themotion information; determining color information based on the attributeof each of the plurality of users, wherein the color informationindicates the degree of excitement of the plurality of users; generatinga heat map image associated with the event, wherein the heat map imageis generated based on the degree of excitement of each of the pluralityof users, the heat map image includes an arrangement of the colorinformation, and the arrangement of the color information in the heatmap image is based on a division of the color information; andtransmitting the heat map image to a display control apparatus, whereinthe display control apparatus controls a display screen to display theheat map image, and the display screen is in a space where the video iscaptured.
 10. A display control apparatus, comprising: a receiving unitconfigured to: receive, from each of a plurality of reproducingapparatuses, first motion information and attribute information, whereinthe first motion information indicates a motion of each user of aplurality of users, the attribute information indicates an attribute ofeach user of the plurality of users, the first motion information isdifferent from the attribute information, each of the plurality ofreproducing apparatuses is associated with a respective user of theplurality of users, and each of the plurality of reproducingapparatuses: receives video content of a video corresponding to anevent; reproduces the video content; and switches a display range of thevideo content within an entire range of the video based on the motion ofthe respective user; and receive a heat map image from an informationprocessing apparatus, wherein the information processing apparatus:determines a degree of excitement of each user of the plurality of usersbased on the first motion information; determines color informationbased on the attribute of each of the plurality of users, wherein thecolor information indicates the degree of excitement of the plurality ofusers; and generates the heat map image associated with the event,wherein the heat map image is generated based on the degree ofexcitement of each of the plurality of users, the heat map imageincludes an arrangement of the color information, and the arrangement ofthe color information on the heat map image is based on a division ofthe color information; and a display control unit configured to controla display screen to display the heat map image, wherein the displayscreen is in a space where the video is captured.
 11. The displaycontrol apparatus according to claim 10, further comprising atransmitting unit, wherein the receiving unit is further configured to:receive second motion information from the plurality of reproducingapparatuses, wherein the second motion information indicates a pluralityof motions of the plurality of users; receive designation informationassociated with a person reflected in the video, wherein the designationinformation indicates: a method to determine the degree of excitementbased on a specific motion of the plurality of motions; and a method toarrange the color information that indicates the degree of excitement,and the transmitting unit is configured to transmit the designationinformation to the information processing apparatus.
 12. A displaycontrol method, comprising: receiving, from each of a plurality ofreproducing apparatuses, motion information and attribute information,wherein the motion information indicates a motion of each user of aplurality of users, the attribute information indicates an attribute ofeach user of the plurality of users, the motion information is differentfrom the attribute information, each of the plurality of reproducingapparatuses is associated with a respective user of the plurality ofusers, and each of the plurality of reproducing apparatuses: receivesvideo content of a video corresponding to an event; reproduces the videocontent; and switches a display range of the video content within anentire range of the video based on the motion of the respective user;receiving a heat map image from an information processing apparatus,wherein the information processing apparatus: determines a degree ofexcitement of each user of the plurality of users based on the motioninformation; determines color information based on the attribute of eachof the plurality of users, wherein the color information indicates thedegree of excitement of the plurality of users; and generates the heatmap image associated with the event, wherein the heat map image isgenerated based on the degree of excitement of each user of theplurality of users, the heat map image includes an arrangement of thecolor information, and the arrangement of the color information in theheat map image is based on a division of the color information; andcontrolling a display screen to display the heat map image, wherein thedisplay screen is in a space where the video is captured.
 13. Anon-transitory computer-readable medium having stored thereoncomputer-readable instructions that, when executed by a processor, causethe processor to execute operations, the operations comprising:receiving, from each of a plurality of reproducing apparatuses, motioninformation and attribute information, wherein the motion informationindicates a motion of each user of a plurality of users, the attributeinformation indicates an attribute of each user of the plurality ofusers, the motion information is different from the attributeinformation, each of the plurality of reproducing apparatuses isassociated with a respective user of the plurality of users, and each ofthe plurality of reproducing apparatuses: receives video content of avideo corresponding to an event; reproduces the video content; andswitches a display range of the video content within an entire range ofthe video based on the motion of the respective user; receiving a heatmap image from an information processing apparatus, wherein theinformation processing apparatus: determines a degree of excitement ofeach user of the plurality of users based on the motion information;determines color information based on the attribute of each of theplurality of users, wherein the color information indicates the degreeof excitement of the plurality of users; and generates the heat mapimage associated with the event, wherein the heat map image is generatedbased on the degree of excitement of each of the plurality of users, theheat map image includes an arrangement of the color information, and thearrangement of the color information in the heat map image is based on adivision of the color information; and controlling a display screen todisplay the heat map image, wherein the display screen is in a spacewhere the video is captured.
 14. A reproducing apparatus, comprising: areceiving unit configured to receive video content of a video,corresponding to an event, with a display range switched within anentire range of the video, wherein the switch of the display range isbased on a first user motion; a reproducing unit configured to reproducethe video content; a detection unit configured to detect the first usermotion; a display unit configured to display the video content of thedisplay range based on the first user motion; and a transmitting unitconfigured to transmit first motion information to an informationprocessing apparatus, wherein the first motion information indicates thefirst user motion, and the information processing apparatus: receivessecond motion information from a specific apparatus, wherein the secondmotion information indicates a second user motion; aggregates the firstmotion information, the second motion information, and attributeinformation indicating each of a first user attribute and a second userattribute, wherein each of the first motion information and the secondmotion information is different from the attribute information;determines a first user degree of excitement based on the first motioninformation; and determines a second user degree of excitement based onthe second motion information; determines color information based on thefirst user attribute and the second user attribute, wherein the colorinformation indicates each of the first user degree of excitement andthe second user degree of excitement; and generates a heat map imageassociated with the event, wherein the heat map image is generated basedon each of the first user degree of excitement and the second userdegree of excitement, the heat map image includes an arrangement of thecolor information, and the arrangement of the color information in theheat map image is based on a division of the color information.
 15. Thereproducing apparatus according to claim 14, wherein the detection unitis further configured to detect a plurality of types of the first usermotion.
 16. A reproducing method, comprising: receiving video content ofa video, corresponding to an event, with a display range switched withinan entire range of the video, wherein the switch of the display range isbased on a first user motion; reproducing the video content; detectingthe first user motion; displaying the video content of the display rangebased on the first user motion; and transmitting first motioninformation to an information processing apparatus, wherein the firstmotion information indicates the first user motion, and the informationprocessing apparatus: receives second motion information from a specificapparatus, wherein the second motion information indicates a second usermotion; aggregates the first motion information, the second motioninformation, and attribute information that indicates a first userattribute and a second user attribute, wherein each of the first motioninformation and the second motion information is different from theattribute information; determines a first user degree of excitementbased on the first motion information; and determines a second userdegree of excitement based on the second motion information; determinescolor information based on the first user attribute and the second userattribute, wherein the color information indicates each of the firstuser degree of excitement and the second user degree of excitement; andgenerates a heat map image associated with the event, wherein the heatmap image is generated based on each of the first user degree ofexcitement and the second user degree of excitement, the heat map imageincludes an arrangement of the color information, and the arrangement ofthe color information in the heat map image is based on a division ofthe color information.
 17. A non-transitory computer-readable mediumhaving stored thereon computer-readable instructions that, when executedby a processor, cause the processor to execute operations, theoperations comprising: receiving video content of a video, correspondingto an event, with a display range switched within an entire range of thevideo, wherein the switch of the display range is based on a first usermotion; reproducing the video content; detecting the first user motion;displaying the video content of the display range based on the firstuser motion; and transmitting first motion information to an informationprocessing apparatus, wherein the first motion information indicates thefirst user motion, and the information processing apparatus: receivessecond motion information from a specific apparatus, wherein the secondmotion information indicates a second user motion; aggregates the firstmotion information, the second motion information, and attributeinformation indicating each of a first user attribute and a second userattribute, wherein each of the first motion information and the secondmotion information is different from the attribute information;determines a first user degree of excitement based on the first motioninformation; and determines a second user degree of excitement based onthe second motion information; determines color information based on thefirst user attribute and the second user attribute, wherein the colorinformation indicates each of the first user degree of excitement andthe second user degree of excitement; and generates a heat map imageassociated with the event, wherein the heat map image is generated basedon each of the first user degree of excitement and the second userdegree of excitement, the heat map image includes an arrangement of thecolor information, and arrangement of the color information in the heatmap image is based on a division of the color information.
 18. Aninformation processing system, comprising: a plurality of reproducingapparatuses, wherein each of the plurality of reproducing apparatuses isassociated with a respective user of a plurality of users, and each ofthe plurality of reproducing apparatuses comprising: a first receivingunit configured to receive video content of a video, corresponding to anevent, with a display range switched within an entire range of thevideo, wherein the switch of the display range is based on a motion ofthe respective user; a reproducing unit configured to reproduce thevideo content; a detection unit configured to detect the motion of therespective user; a display unit configured to display the video contentof the display range based on the motion of the respective user; and afirst transmitting unit configured to transmit motion information to aninformation processing apparatus, wherein the motion informationindicates the motion of each user of the plurality of users, theinformation processing apparatus aggregates the motion information withattribute information, the attribute information indicates an attributeof each user of the plurality of users, and the attribute information isdifferent from the motion information; the information processingapparatus comprising: a second receiving unit configured to receive themotion information and the attribute information from each of theplurality of reproducing apparatuses; a generation unit configured to:determine a degree of excitement of each user of the plurality of usersbased on the motion information; determine color information based onthe attribute of each user of the plurality of users, wherein the colorinformation indicates the degree of excitement of the plurality ofusers; and generate a heat map image associated with the event, whereinthe heat map image is generated based on the degree of excitement ofeach user of the plurality of users, the heat map image includes anarrangement of the color information, and the arrangement of the colorinformation in the heat map image is based on a division of the colorinformation; and a second transmitting unit configured to transmit theheat map image to a display control apparatus; and the display controlapparatus comprising: a third receiving unit configured to receive theheat map image from the information processing apparatus; and a displaycontrol unit configured to control a display screen to display the heatmap image, wherein the display screen is in a space where the video iscaptured.